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ABSTRACT 

In optimal placement of actuators for stochastic systems, it is commonly assumed that 
the actuator noise variances are not related to the feedback matrix and the actuator locations. 
In this paper, wc will discuss the limitation of that assumption and develop a more practical 
noise variance model. Various properties associated with optimal actuator placement under 
the assumption of (his noise variance model are discovered through the analytical study of a 
second order system. 

Introduction 

Refs. ( 1-4] are typical works in the literature for actuator placement of stochastic 
systems. In all of these works, it is assumed that the noise strengths of the actuators are given 
and not related to the feedback and actuator locations — an assumption made in the LOG 
theory. However, as shown in Ref. |5|, this noise variance model is not always true in practice. 
For example, the noise strength of an actuator may depend on its capacity (the largest signal it 
can produce) and the magnitude of its producing signal. Clearly, if a person (actuator) is 
required to push an object with 1 Ibf (small signal), the error of the produced force will be 
probably several ounces (small variance). However, if he is required to push thcobjecl with 100 
Ibf (large signal), the errorof the produced force will be several or ten pounds (large variance). 
Also, the noise of a reaction wheel (actuator) may be caused by the bearing and eccentricity of 
the wheel, etc. If a reaction wheel is required to produce a larger signal (larger capacity), it is 
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usually required (o increase Ihe inertial of the wheel and/or the maximum spinning speed, then 
the noise caused by the bearing and eccentricity will be greater. These facts show that the 
actuator noise strength usually depends on the capacity and (he signal magnitude of the 
actuator. Since the signal magnitude and the required capacity of the actuator depend on the 
feedback matrix and the actuator location, Ihe noise strength of the actuator implicitly 
depends on the feedback mat rix and the actuator location. Clearly, when an actuator is placed 
at a carefully selected location, the control force and (he required capacity of (he actuator will 
be smaller. Also, the signal and capacity will depend on (he feedback matrix because a smaller 
feedback (slower system) usually requires a smaller control force. Since the ordinary LOG 
theory neglects these facts, it cannot be used to reduce the noise variance of the actuator 
through the selection of a feedback matrix and actuator locations, and thus results in 
unnecessarily noisy systems. 

A New Noise Variance Model 

In most practical applications, the actuator noise variance increases with its capacity and 
signal magnitude. Since (he required capacity in steady slate is related to the signal variance of 
the actuator, we can reasonably use the signal variance to represent the actuator capacity in 
the new noise variance model. To take into account (he effects of the signal magnitude on the 
noise variance, we may use the signal square in the noise variance model. However, this 
method will result in time-dependent noise variance and make analysis very complicated. In 
order to simplify the analysis, we can use the time average method, then signal square again 
becomes signal variance. According to the discussion above, we can develop a realistic noise 
variance model of an actuator as 

W = a J +p Aacr*+p (l) 


where of, is the variance of the actuator signal in steady slate. of and (3 are non-negative 
constants which depend on manufacturing processes. The term of ct* reflects the contribution 



of I he actuator signal magnitude, and the term of cr* reflects (he contribution of the actuator’s 
capacity. An advantage of this noise variance model is (hat (he noise is still white, Gaussian 
with constant variance, and thus analysis can be simplified. The only difference from the 
ordinary model is that the noise variance in the new model will depend on the capacity 
and signal magnitude of the actuator, and will thus implicitly depend on the feedback 
and actuator locations. 



A Physical System 

The new noise variance model, Eq. (1), will be applied to a second order system shown in 

figure I. In the system, w is the plant disturbance with given strength w, but w is actuator noise 
whose strength is governed by Eq. (I). The actuator orientation (location) is specified by angle, 
9. Obviously, the actuator is most efficient when 9 = 0, and is most desirable for a deterministic 
system. However, as shown in Ref. f 1 1, 1 he selection of 9 = 0 may not give optimal performance 
for stochastic systems, especially when the ratio of plant disturbance to actuator noise is small. 
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The slate equation is given by 


x = Ax + B(u+w) + G w (2) 

with 



where b = cos 9. Without losing generality, we assume 0<b<l. Clearly, matrix G is fixed but 
matrix B changes with actuator location. The feedback control law is given by 

u = -F x (4) 

The objective of the problem is to find the optimal feedback F, and the optimal actuator 
orientation b, so that the following cost function is minimized: 

J = E^l q x T x + r u 2 ] ^ 

where q and r are given weights, Eqq is the mean operator when the time period approaches 
infinity. 

Since the noise is still white and Gaussian with constant variance, we can use stochastic 


control theory to find the variance of the state, P x : 

P x (A - BF) t + (A - BF) P x + BWB 1 + GwG 1 =0 (6) 

The solution of Eq. (6) is given by 

Px = diag [P xl , P x2 ] (7) 

with 

p = b 2 p + W 

1 2b 2 f, f 2 - ab 2 ff - « b3f ] f 2 W 

p x 2 = bfjPxj ( 9 ) 

The cost function (5) can be rewritten as 

J = (q + rf 2 )P XJ + (q + rf 2 )P X2 ( 10 > 
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where f | and f 2 are elements of the feedback matrix. When the weights, noise parameters and 
the actuator orientation arc all given, the cost will be a function of ft and f 2 . The optimal 
feedback can be obtained by our equating the partial derivatives of the cost with respect to fj 
and f 2 to zero. After substantial mathematical manipulation, the equations for optimal 
feedback become 

bf 2 -bf 2 + 2 f 1 = 0 (11) 

f2= J-(l-abf 2 ) (12) 

These equations give optimal feedback when the actuator orientation is fixed. We can see that 
the feedback matrix docs not depend on the plant disturbance and p since they correspond to 
(he ordinary noise variance in LOG theory. Eqs. (11-12) are a parabolic equation and a 
hyperbolic equal ion. Those equal ions can be plot led in the f|-f 2 plane (Fig. 2), and may give up 
to 4 intersection points. By inspection, only one point out of the 4 corresponds to a stable 
system. It should be noted that for the new noise variance model the solution obtained from 
ordinary LOG method is no longer optimal. The solution of the feedback corresponding to 
ordinary noise variance model (LOG) can be obtained by our equating o to zero, and is also 
plotted in the figure. The trends of (he new and ordinary solutions and their difference can be 
seen clearly from the figure when q/r, b, ora is changed. It shows that the optimal f| is between 
0 and l/(ab), and the optimal f 2 is between 0 and sqrt(q/r). When a becomes larger or q/r 
becomes larger, the difference between the optimal solution and the ordinary LQG solution 
becomes more significant. Both elements of the optimal feedback matrix are smaller than 
those obtained by LOG method. Clearly, smaller feedback elements help to reduce the 
actuator noise. 

To find optimal actuator orientation, we differentiate the cost with respect to b by 


considering the feedback elements as functions of b. By equating the derivative to zero, we 
obtain a really complicated equation for optimal actuator location. After much mathematical 
manipulation (he equation becomes: 
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b 2 (l +hf 1 ) I -S-« 2 (l+b() 2 +4f^-4«f 1 f 2 ]-(3 + bf i )[2f 2 -3af r baf2| 2 = 0 

(13) 

It can be seen that \y/(3 does no I affect the feedback but it docs affect the optimal actuator 
location. The optimal actuator location differs from that obtained by the ordinary noise variance 
model in Ref. [ 1 ], and the latter can also be obtained by our equating a to zero in Eq. (13). 

Eqs. (1 1—13) can be solved simultaneously to obtain the optimal feedback and the 
optimal actuator location. Some properties of Eqs. (1 1-13) can simplify (he computation of 
the optimal feedback and optimal actuator location. For example, there is one and only one 
solution of f| between 0 and sqrt(q/r) if o: is not zero, and the left side of Eq. (13) is a 
monotonous function of b. 

It is particularly interesting to investigate Eq. (13) when b= I. In this case, for different 

values of «, we can plot w/p as a function of q/r, as shown in Fig. 3. In the W/p-q/r plane, for a 
specific a, the optimal b in the area above the corresponding curve is larger than 1, and the 
optimal b in the area below the corresponding curve is smaller than 1. Since b ( = cos 0) can not 
be greater than 1, we must use b = I in the area above the corresponding curve. 

Fig. 4 shows (he optimal b as a function of a and q/r when w/p= I. Clearly, optimal b 
decreases with or and q/r and could be significantly less than I. Computation also shows that 
when \v/p decreases the optimal b will also decrease; when w/p increases (he optimal b will 
also increase. 

Conclusion 

In many applications, a more practical noise variance model of an actuator than the one 
in LOO theory is (hat its noise variance increases with its signal variance. In this paper, we 
investigated the optimal control and optimal actuator placement when the actuator noise 
variance increases linearly with its signal variance. In this case the feedback and actuator 
location obtained by ordinary LQG theory are no longer optimal. 
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Optimal b 



Figure '\. T he optimal actuator location b as a function of q/r and a. when W/P = I. 
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